Cognitively Inspired Anticipatory Adaptation and Associated Learning Mechanisms for Autonomous Agents
نویسندگان
چکیده
This paper describes the integration of several cognitively inspired anticipation and anticipatory learning mechanisms in an autonomous agent architecture, the Learning Intelligent Distribution Agent (LIDA) system. We provide computational mechanisms and experimental simulations for variants of payoff, state, and sensorial anticipatory mechanisms. The payoff anticipatory mechanism in LIDA is implicitly realized by the action selection dynamics of LIDA’s decision making component, and is enhanced by importance and discrimination factors. A description of a non-routine problem solving algorithm is presented as a form of state anticipatory mechanism. A technique for action driven sensational and attentional biasing similar to a preafferent signal and preparatory attention is offered as a viable sensorial anticipatory mechanism. We also present an automatization mechanism coupled with an associated deautomatization procedure, and an instructionalist based procedural learning algorithm as forms of implicit and explicit anticipatory learning mechanisms.
منابع مشابه
Cognitively Inspired Anticipation and Anticipatory Learning Mechanisms for Autonomous Agents
This paper describes the integration of several cognitively inspired anticipation and anticipatory learning mechanisms in an autonomous agent architecture, the Learning Intelligent Distribution Agent (LIDA) system. We provide computational mechanisms for variants of payoff, state, and sensorial anticipatory mechanisms. The payoff anticipatory mechanism in LIDA is implicitly realized by the acti...
متن کاملAffect, Anticipation and Adaptation: Affect-Controlled Selection of Anticipatory Simulation in Artifical Adaptive Agents
Emotion plays an important role in thinking. In this paper we study affective control of the amount of simulated anticipatory behavior in adaptive agents using a computational model. Our approach is based on model-based reinforcement learning (RL) and inspired by the Simulation Hypothesis (Cotterill, 2001; Hesslow, 2002). The simulation hypothesis states that thinking is internal simulation of ...
متن کاملAffect, Anticipation, and Adaptation: Affect-Controlled Selection of Anticipatory Simulation in Artificial Adaptive Agents
Emotion plays an important role in thinking. In this article we study affective control of the amount of simulated anticipatory behavior in adaptive agents using a computational model. Our approach is based on model-based reinforcement learning (RL) and inspired by the simulation hypothesis (Cotterill, 2001; Hesslow, 2002). The simulation hypothesis states that thinking is internal simulation o...
متن کاملBiologically-inspired adaptation of autonomic network applications
This paper describes and empirically evaluates a new biologically-inspired adaptation mechanism for network applications in the NetSphere architecture. The NetSphere architecture is inspired by the observation that the biological systems (e.g. bee colonies) have already developed mechanisms necessary to achieve future network requirements such as autonomy and adaptability. In the NetSphere arch...
متن کاملAnticipations, Brains, Individual and Social Behavior: An Introduction to Anticipatory Systems
Research on anticipatory behavior in adaptive learning systems continues to gain more recognition and appreciation in various research disciplines. This book provides an overarching view on anticipatory mechanisms in cognition, learning, and behavior. It connects the knowledge from cognitive psychology, neuroscience, and linguistics with that of artificial intelligence, machine learning, cognit...
متن کامل